Okeanos: Wasteless Journaling for Fast and Reliable Multistream Storage
نویسنده
چکیده
Synchronous small writes play a critical role in the reliability and availability of file systems and applications that use them to safely log recent state modifications and quickly recover from failures. However, storage stacks usually enforce page-sized granularity in their data transfers from memory to disk. We experimentally show that subpage writes may lead to storage bandwidth waste and high disk latencies. To address the issue in a journaled file system, we propose wasteless journaling as a mount mode that coalesces synchronous concurrent small writes of data into full page-sized blocks before transferring them to the journal. Additionally, we propose selective journaling that automatically applies wasteless journaling on data writes whose size lies below a fixed preconfigured threshold. In the Okeanos prototype implementation that we developed, we use microbenchmarks and application-level workloads to show substantial improvements in write latency, transaction throughput and storage bandwidth requirements.
منابع مشابه
Reducing Bandwidth Waste in Reliable Multistream Storage
Synchronous small writes play a critical role in the reliability and availability of current systems because they are used to safely log recent state modifications and allow fast recovery after failures at the application and system level. In highly demanding environments, it is typical to dedicate separate devices for the logging activity alone. Thus, systems provide adequate performance durin...
متن کاملOkeanos: Fast and Reliable Stream Storage Through Differential Data Journaling
Real-time storage of massive stream data is emerging as a critical component in modern computing infrastructures used for continuous monitoring purposes. Traditional file and database systems are not designed for such operation environments and incur excessive resource requirements when handling high-volume streaming traffic. In the present paper, we examine the possibility of employing data jo...
متن کاملEfficient Object Storage Journaling in a Distributed Parallel File System
Journaling is a widely used technique to increase file system robustness against metadata and/or data corruptions. While the overhead of journaling can be masked by the page cache for small-scale, local file systems, we found that Lustre’s use of journaling for the object store significantly impacted the overall performance of our large-scale centerwide parallel file system. By requiring that e...
متن کاملUnioning of the buffer cache and journaling layers with non-volatile memory
Journaling techniques are widely used in modern file systems as they provide high reliability and fast recovery from system failures. However, it reduces the performance benefit of buffer caching as journaling accounts for a bulk of the storage writes in real system environments. In this paper, we present a novel buffer cache architecture that subsumes the functionality of caching and journalin...
متن کاملBarrier-Enabled IO Stack for Flash Storage
This work is dedicated to eliminating the overhead of guaranteeing the storage order in modern IO stack. The existing block device adopts prohibitively expensive resort in ensuring the storage order among write requests: interleaving successive write requests with transfer and flush. Exploiting the cache barrier command for the Flash storage, we overhaul the IO scheduler, the dispatch module an...
متن کامل